L 

Number 


Hits 


Search Text 


DB 


Time stamp 


- 


29449 


image with encrypt $4 encod$4) 


US PAT ; 


2003/07/24 








US-PGPUB; 


16:57 








EPO; JPO; 










IBM TDB 




- 


19176 


image with (encrypt$4 encod$4) and 


US PAT; 


2003/07/24 






process 


US-PGPUB; 


16:57 








EPO; JPO; 










IBM TDB 




- 


24393 


image with {encrypt $4 encod$4) and 


US PAT; 


2003/07/24 






process$4 


US-PGPUB; 


16:58 








EPO; JPO; 










IBM TDB 




- 


19514 


image with (encrypt $4 encod$4) and 


US PAT; 


2003/07/24 






process$4 with image 


US-PGPUB; 


17:33 








EPO; JPO; 










IBM TDB 




- 


14094 


image with (encrypt$4 encod$4) and 


US PAT; 


2003/07/24 






process$4 with image and (input$4 read$4) 


US-PGPUB; 


17:35 






with image 


EPO; JPO; 










IBM TDB 




- 


4471 


image with (encrypt$4 encod$4) and 


US PAT; 


2003/07/24 






process$4 with image and (input$4 read$4) 


US-PGPUB; 


17:36 






with image and (divid$4 break$4) with'. ... 


EPO; JPO; 








image 


IBM TDB 




- 


1750 


image with (encrypt $4 encod$4) and 


US PAT; 


2003/07/24 






process$4 with image and {input$4 read$4) 


US-PGPUB; 


17:40 . 






with image and (divid$4 break$4) with 


EPO; JPO; 








image and {boundar$4 (divid$4 near 4 


IBM_TDB 








size) ) 






- 


0 


image with (encrypt$4 encod$4) and 


US PAT; 


2003/07/24 






process$4 with image and (input$4 read$4) 


US-PGPUB; 


17:41 






with image and (divid$4 break$4) with 


EPO; JPO; 








image and (boundar$4 (divid$4 near4 


IBM_TDB 








size) ) and mark$4 adj mean 






- 


82 


image with (encrypt $4 encod$4) and 


US PAT; 


2003/07/24 






process$4 with image and (input$4 read$4) 


US-PGPUB; 


17:42 






with image and (divid$4 break$4) with 


EPO; JPO; 








image and (boundar$4 (divid$4 near 4 


IBM_TDB 








size) ) and mark$4 with identif$4 






- 


56 


image with (encrypt $4 encod$4) and 


US PAT; 


2003/07/24 






process$4 with image and (input$4 read$4) 


US-PGPUB; 


17:43 






with image and (divid$4 break$4) with 


EPO; JPO; 








image and (boundar$4 (divid$4 near4 


IBM__TDB 








size) ) and mark$4 with identif$4 and 










position with image 






- 


51 


image with (encrypt $4 encod$4) and 


US PAT; 


2003/07/24 






process$4 with image and (input $4 read$4) 


US-PGPUB; 


17:45 






with image and (divid$4 break$4) with 


EPO; JPO; 








image and {boundar$4 (divid$4 near 4 


IBM_TDB 








size) ) and mark$4 with identif$4 and 










position with image and image with •., 










information and siz$4 






- 


1 


707/$. eels . and image with (encrypt$4 


US PAT; 


2003/07/25 






encod$4) and process$4 with image and 


US-PGPUB; 


08:29 






(input$4 read$4) with image and (divid$4 


EPO; JPO; 








break$4) with image and (boundar$4 


IBM_TDB 








(divid$4 near4 size) ) and mark$4 with 










identif$4 and position with image and 










image with information and siz$4 






- 


51 


image with (encrypt $4 encod$4) and 


US PAT; 


2003/07/25 






process$4 with image and (input$4 read$4) 


US-PGPUB; 


08:24 






with image and (divid$4 break$4) with 


EPO; JPO; 








image and (boundar$4 (divid$4 near4 


IBM TDB 








size) ) and mark$4 with identif $4 and 










position with image and image with 










information and si2$4 not fujitsu.as. 







Search History 5/5/04 11:47:24 AM Page 1 
C:\APPS\EAST\Workspaces\A24-Ito.wsp 



51 



31 



19 



16 



image with (encrypt$4 encod$4) and 
proces3$4 with image and (input$4 read$4) 
with image and (divid$4 break$4) with . 
image and (boundar$4 (divid$4 near4 
size)) and mark$4 with identif$4 and 
position with image and image with 
information and siz$4 not fuji.as. 
image with (encrypt$4 encod$4) and 
process$4 with image and (input$4 read$4) 
with image and {divid$4 break$4) with 
image and (boundar$4 (divid$4 near4 " 
size)) and mark$4 with identif$4 and 
position with image and image with 
information and siz$4 not fuji.as. and 
first adj process$4 
image with (encrypt$4 encod$4) and 
process$4 with image and {input$4 read$4) 
with image and (divid$4 break$4) with 
image and (boundar$4 (divid$4 near4 
size)) and mark$4 with identif$4 and 
position with image and image with 
information and 3iz$4 not fuji.as. and 
first adj process$4 and second adj 
procress$4 

image with (encrypt $4 encod$4) and 
process$4 with image and (input $4 read$4) 
with image and (divid$4 break$4) with 
image and (boundar$4 (divid$4 near 4 
size)) and mark$4 with identif$4 and 
position with image and image with 
information and siz$4 not fuji.as. and v. 
(multiple various plurality) adj 
process$4 

image with (encrypt $4 encod$4) and 
process$4 with image and (input $4 read$4) 
with image and (divid$4 break$4) with 
image and (boundar$4 (divid$4 near4 
size) ) and mark$4 with identif$4 and 
position with image and image with 
information and siz$4 not fuji.as. and 
(multiple various plurality) with 
process$4 

image with (encrypt $4 encod$4) and 
process$4 with image and (input$4 read$4) 
with image and (divid$4 break$4) with 
image and (boundar$4 (divid$4 near 4 
size) ) and mark$4 with identif $4 and 
position with image and image with 
information and siz$4 not fuji.as. and 
(multiple various plurality) near4 
process$4 

image with (encrypt $4 encod$4) and 
process$4 with image and {input$4 read$4) 
with image and (divid$4 break$4) near4 
image and (boundar$4 (divid$4 near 4 
size) ) and mark$4 with identif $4 and 
position with image and image with 
information and siz$4 not fuji.as. and 
(multiple various plurality) near4 v. , 
process$4 

image with (encrypt $4 encod$4) and 
process$4 with image and (input$4 read$4) 
with image and (divid$4 break$4) with 
image and (boundar$4 (divid$4 near 4 
size)) and mark$4 with identif$4 and 
position with image and image with 
information and siz$4 not fuji.as. and 
(multiple various plurality) adj process 



US PAT ; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



US PAT ; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



US PAT; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



US PAT; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



US PAT; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



US PAT; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



US PAT; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



US PAT; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



2003/07/25 
09:09 



2003/07/25 
08:38 



2003/07/25 
08:39 



2003/07/25 
08:54 



2003/07/25 
08:57 



2003/07/25 
09:00 



2003/07/25 
09:05 



2003/07/25 
09:03 



Search History 5/5/04 11:47:24 AM Page 2 
C : \APPS\EAST\Workspaces\A2 4 -I to . wsp 



237 



95 



55 



33 



image with encrypt$4 and process$4 with 
image and {input $4 read$4) with image and 
(divid$4 break$4) near4 image and 
(boundar$4 {divid$4 near4 size) ) and 
mark$4 with identif$4 and position with 
image and image with information and 
siz$4 not fuji.as. and (multiple various 
plurality) near4 process$4 
image with encrypt $4 and process? 4 with-., 
image and (input$4 read$4) with image and 
(divid$4 slic$4 break$4) near4 image and 
(boundar$4 (divid$4 near4 size)) and 
mark$4 with identif$4 and position with 
image and image with information and 
siz$4 not fuji.as. and (multiple various 
plurality) near4 process$4 
image with encrypt$4 and process$4 with 
image and (input$4 read$4) with image and 
(divid$4 slic$4 break$4) near4 image and 
(boundar$4 (divid$4 near4 size) ) and 
mark$4 with identif$4 and position with 
image and image with information and 
siz$4 not fuji.as. 

image with encrypt$4 and process$4 with 
image and (input $4 read$4) with image and 
(divid$4 break$4) with image and 
(boundar$4 (divid$4 near4 size) ) and 
mark$4 with identif$4 and position with 
image and image with information and 
s i z $ 4 not f u j i . as . 

image with (encrypt$4 scrambl$4) and 
process$4 with image and (input$4 read$4) 
with image and (divid$4 break$4) near4 
image and (boundar$4 (divid$4 near4 
size) ) and mark$4 with identif $4 and 
position with image and image with 
information and siz$4 not fuji.as. 
image with (encrypt $4 scrambl$4) and 
process$4 with image and (input$4 read$4) 
with image and (divid$4 break$4) near4 
image and (boundar$4 (divid$4 near 4 
size) ) and mark$4 with identif $4 and 
position with image and image with 
information and siz$4 not fuji.as. and 
divid$4 with pre$determin$4 
image adj encrypt $4 



image adj encrypt $4 and image with 
portion 



image adj encrypt $4 and image with 
portion and image with secur$4 



image adj encrypt $4 and image with 
portion and image with secur$4 with 
encrypt$4 

image adj encrypt $4 and image with 
portion and image with secur$4 with 
encrypt$4 and image with divid$4 with 
portion 

image adj encrypt $4 and image with 
portion and image with secur$4 with 
encrypt$4 and image with divid$4 with 
portion and encrypt $4 with portion and 
incidental 



US PAT ; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



USPAT; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



USPAT; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



USPAT; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



USPAT; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



USPAT; 
US-PGPUB; 
EPO; JPO; 
IBM TDB 



USPAT; 

US-PGPUB; 

EPO; JPO; 

IBM_TDB 

USPAT; 

US-PGPUB; 

EPO; JPO; 

IBM_TDB 

USPAT; 

US-PGPUB; 

EPO; JPO; 

IBM_TDB 

USPAT; 

US-PGPUB; 

EPO; JPO; 

IBM_TDB 

USPAT; 

US-PGPUB; 

EPO; JPO; 

IBM_TDB 

USPAT; 

US-PGPUB; 

EPO; JPO; 

IBM TDB 



2003/07/25 
09:07 



2003/07/25 
09:07 



2003/07/25 
09:08 



2003/07/25 
09:15 



2003/07/25 
09:57 



2003/11/18 
14:02 



2003/11/18 
14:03 



2003/11/18 
14:03 



2003/11/18 
14:03 



2003/11/18 
14:05 



2003/11/18 
14:06 



2003/11/18 
14:07 



Search History 5/5/04 11:47:24 AM Page 3 
C : \APPS\EAST \Wor kspaces\A2 4 - 1 to . wsp 













- 


5 


image adj encrypt $4 and image with 


US PAT ; 


2003/11/18 






portion and image with secur$4 with 


US-PGPUB; 


14 : 11 






encrypt$4 and image with divid$4 with 


EPO; JPO; 








portion and encrypt $4 with portion 


IBM_TDB 


2003/11/18 


- 


16 


image adj encrypt$4 and image with 


US PAT; 






portion and image with secur$4 with 


US-PGPUB; 


14 : 11 






encrypt$4 and image with portion and 


EPO; JPO; 








encrypt$4 with portion 


IBM_TDB 


2003/11/18 


- 


8 


image adj encrypt$4 and image with 


US PAT; 






portion and image with secur$4 with 


US-PGPUB; 


14 : 11 






encrypt$4 and image with portion and 


EPO; JPO; 








encrypt$4 with portion and un$authorized 


IBM TDB 




- 


3485 


(713/176 382/100 382/199 380/51) . eels . 


US PAT; 


2004/05/05 






US-PGPUB; 
EPO; JPO; 
IBM_TDB 


09:47 




208 


{713/176 382/100 382/199 380/51 }. eels . 


US PAT; 


2004/05/05 






and enerypt$4 and deerypt$4 and portion 


US-PGPUB; 


09:48 






with image 


EPO; JPO; 
IBM_TDB 






264 


(713/176 382/100 382/199 380/51 ). eels . 


US PAT; 


2004/05/05 






and encrypt $4 and decrypt $4 and (part 


US-PGPUB; 


09:48 






section portion) with image 


EPO; JPO; 
IBM_TDB 




- 


22 


(713/176 382/100 382/199 380/5 1 ). eels . 


US PAT; 


2004/05/05 






and encrypt $4 and decrypt $4 and (part 


US-PGPUB; 


09 : 49 






section portion) with image and without 


EPO; JPO; 








with deerypt$4 


IBM_TDB 


2004/05/05 


- 


2 


(713/176 382/100 382/199 380/5 1 ). eels . 


US PAT; 






and encrypt$4 and deerypt$4 and (part 


US-PGPUB; 


09:51 






section portion) with image and without 


EPO; JPO; 








with decrypt$4 and (remain$4 stay$4) with 


IBM_TDB 








encrypt $4 




2004/05/05 


- 


1 


(713/176 382/100 382/199 380/5 1 ). eels . 


US PAT; 






and encrypt$4 and decrypt$4 and (part 


US-PGPUB; 


09 : 52 






section portion) with image and without 


EPO; JPO; 








with decrypt$4 and (remain$4 stay$4) adj 


IBM_TDB 








(secur$4 enerypt$4) 




2004/05/05 


- 


2 


(713/176 382/100 382/199 380/51) . eels . 


US PAT ; 






and (portion section segment part) with 


US-PGPUB; 


09 : 55 






image with {remain$4 stay$4) with 


EPO; JPO; 








(secur$4 enerypt$4 protect$4) 


IBM_TDB 


2004/05/05 


- 


0 


(713/176 382/100 382/199 380/51) . eels ^ 


US PAT; 






and (portion section segment part) with 


US-PGPUB; 


09:56 






image with (remain$4 stay$4) adj {secur$4 


EPO; JPO; 








enerypt$4 protect$4) 


IBM_TDB 


2004/05/05 


- 


0 


(713/$ 382/$ 380/$). eels, and (portion 


US PAT; 






section segment part) with image with 


US-PGPUB; 


09 : 57 






(remain$4 stay$4) adj (seeur$4 encrypt$4 


EPO; JPO; 








protect$4) 


IBM_TDB 


OAA/I /AC / AC 

2004/05/05 


- 


3 


(713/$ 382/$ 380/$). eels, and (portion 


US PAT; 






section segment part) with image with 


US-PGPUB; 


09 : 59 






(remain$4 stay$4) near4 (secur$4 


EPO; JPO; 








encrypt$4 protect$4) 


IBM_TDB 


2004/05/05 


- 


3 


(713/$ 382/$ 380/$). eels, and (portion 


US PAT; 






section segment part) with image with 


US-PGPUB; 


10 : 00 






(remain$4 stay$4) near4 (seeur$4 


EPO; JPO; 








encrypt$4 proteet$4 decrypt$4) 


IBM_TDB 


i^rtrt>l / f\ c /AC 

2004/05/05 


_ 


88 


(713/$ 382/$ 380/$). eels, and (portion 


US PAT; 






section segment part) adj image with 


US-PGPUB; 


10:01 






(seeur$4 encrypt$4 protect$4 decrypt$4) 


EPO; JPO; 
IBM_TDB 






24 


(713/$ 382/$ 380/$). eels, and (portion 


US PAT; 


2004/05/05 






section segment part) near image near 


US-PGPUB; 


10:35 






(seeur$4 enerypt$4 proteet$4 deerypt$4) 


EPO; JPO; 
IBM__TDB 




- 


17 


(713/$ 382/$ 380/$). eels, and encrypt$4 


US PAT; 


2004/05/05 






and (portion section segment part) near 


US-PGPUB; 


10:36 






image near (seeur$4 enerypt$4 protect$4 










deerypt$4 ) 


IBM TDB 





Search History 5/5/04 11:47:24 AM Page 4 
C : \APPS\EAST\Work3paee3\A24-Ito.wsp 



iiiiiiiiiiiiiiiiniiiiiiiiiiiii 



United States Patent [i9] 

Wootton et al. 



US005870471A 

[11] Patent Number: 
[45] Date of Patent: 



5,870,471 
Feb. 9, 1999 



[54] AUTHENTICATION ALGORITHMS FOR 
VIDEO IMAGES 

[75] Inventors: John R. Wootton; Gary S. Waldman, 
both of St. Louis; Gregory L. Hobson, 
St. Charles, all of Mo. 

[73] Assignee: Esco Electronics Corporatton, St. 

Louis, Mo. 



[21] 

[22] 

[51] 
[52] 

[58] 
[56] 



AppL No.: 757,838 In^f?^ 
Filed: Nov. 27, 1996 1 0 IjsXjJ 

Int. CI.* H04L 9/32; G06K 9/36 

U.S. CI 380/10; 380/23; 382/253; 

348/232;'348/441; 348/552 

Field of Search 380/10, 23; 382/253; 

348/232, 441, 552 

References Cited 

U.S. EAJENT DOCUMENTS 

4,161,750 7/1979 Kamin . 

4,257,063 3/1981 Loughry et al. . 

4,342,987 8/1982 Rossin . 

4,364,030 12/1982 Rossin. 

4,679,077 7/1987 Yuasa et aL . 

4,847,485 7/1989 Koelsch . 

4,903,009 2/1990 D'Ambrosia et al. . 

4,939,359 7/1990 Freeman. 

4,949,074 8/1990 D'Ambrosia et al. . 

4,952,911 8/1990 D'Ambrosia et al. . 

4,967,183 10/1990 D'Ambrosia et al. . 

4,972,476 11/1990 Nathans 380/23 

5,091,780 2/1992 Pomerleau . 

5,101,194 3/1992 Sheffer . 

5,231,663 7/1993 Eail et al 380/18 



5,253,070 
5,283,551 
5,289,275 
5,305,390 
5398,057 
5,422,981 
5,499,294 
5,517,429 
5,576,972 
5,579,393 



10/1993 
2/1994 
2/1994 
4/1994 
3/1995 
6/1995 
3/1996 
5/1996 
11/1996 
11/1996 



Hong . 
Guscott . 
Ishii et al. . 
Frey et al. . 
Tapp. 
Niki. 

Friedman 

Harrison . 
Harrison . 
Conner et al. 



380/10 
380/25 



Primary Examiner — Gilbcrto Barron, Jr. 

Attorney, Agent, or Firm—Poht&T, Licder, Woodruff & 

Lucchcsi LC 



[57] 



ABSTRACT 



A method of authenticating a video image created by a 
camera (V; or similar video device. The image is formed 
into a first 2-dimensional pixel array (Al) with each pixel 
(pm^ represented by a data word of a predetermined length. 
This formatted array is converted into a second 
2-dimensional array (A2) which may be made smaller than 
the first array by eliminating rows and columns from the 
formatted array. A first hnear vector (A3) is created using the 
data words in the second array, and a second linear vector 
(A4) is created by repositioning the data words from the first 
linear vector in a random pattern. A checksum is created by 
smnming the contents of all of the data words in the second 
linear vector beginning at a location established by a pre- 
established formula. A header (H) is formed using the 
resulting checksum, information identifying the device used 
to create the image, and the time the image is formed. The 
header is attached to the formatted image and is transmitted 
and stored with the formatted image to subsequently authen- 
ticate the contents of the original image. 
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1 

AUTHENTICATION ALGORITHMS FOR 
VIDEO IMAGES 

CROSS-REFERENCE TO RELATED 

APPUCAnONS 5 

The subject matter contained in this application is related 
to U.S. patent applications Set. No. 08/772^95, filed Dec. 
23, 1996; 08/772,731, filed Dec. 23, 1996; and Ser. No. 
08/771,991, filed Dec. 23, 1996. 

This application is related to U.S. patent application Ser. 
No. 08/772,595 filed Dec. 23, 1996 enUtled REJECTION 
OF UGHT INTRUSION FALSE ALARMS IN VIDEO 
SECURITY SYSTEM; U.S. pateot application Ser. No. 
08/772,731, filed Dec. 23, 1996 entitled LOW FALSE 15 
ALARM RATE DETECTION FOR VIDEO IMAGE PRO- 
CESSING BASED SECURITY ALARM SYSTEM; and 
U.S. patent application Ser. No. 08/771,991, filed Dec. 23, 
1996 entitled REDUCTION IN FALSE ALARM OF 
IMAGE PROCESSING BASED SECURITY SYSTEM BY 20 
PERFORMING CLASSIFICATION OF OBJECTS 
DETECTED. 

STATEMENT REGARDING FEDERALLY 
SPONSORED RESEARCH OR DEVELOPMENT ^ 

Not applicable. 

BACKGROUND OF THE INVENTION 

This invention relates to the authentication of visual 
images such as are produced by a video camera or the like, 
and more particularly to a method of authentication employ- 
ing algorithms to encode informatioa by which the image 
can be authenticated. 

Hiere are a variety of situations in which it is important 35 
to know that a visual image such as an image transmitted 
from one location to another, or a stored image which is to 
be used at a later time is provided or maintained in the exact 
form in which it was produced. In the medical field, for 
example, it is now commonplace to transmit a picture (a 40 
visual image) of a patient from one site (a local hospital, for 
example) to another (the location of a specialist). The image 
may be an x-ray, CAT scan image, or other image of the 
patient. Because the image may be used in making a 
diagnosis, describing a medication or course of treatment, or 45 
viewed by a specialist while surgery is being performed, any 
inaccuracies in the received image can potentially have 
serious consequences. And, it is known that transmission 
errors due to noise on the transmission line, temporary 
disruptions, etc, do occur. 50 

As a further example, many police interrogation rooms 
are equipped with video equipment so the police examina- 
tion of a suspect can be recorded. The resulting record can 
then be used for evidentiary purposes, as wcD as to defend 
the police against charges by a suspect that he was mis- 55 
treated or that a confession was forced from him. 

In security systems, to use another example, a video 
system may capture the image of an intruder during an 
unauthorized entry. The image therefore can become part of 
the evidence which is used to prosecute a suspect. To use the 60 
image as evidence against the suspect at trial, it is necessary 
to maintain the image in its original form and do so in a way 
that the custodian of the evidence can clearly demonstrate to 
a court that the image has not been tampered with. It is well 
known that technology exists by which images can be 65 
modified. Such technology can be used to alter the image in 
such a way that its evidentiary value is destroyed. It is thus 
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important to provide a foolproof method by which tamper- 
ing can be prevented, or if tampering occurs, it is readily 
discernible. 

BRIEF SUMMARY OF THE INVENTION 

Among the several objects of the present invention may 
be noted the provision of a method of authenticating visual 
images so to prevent tampering with the image, or if the 
image is transmitted from one locarioo to another, to make 
it easy to determine if the image which was received exactly 
corresponds with that which was transmitted; 

t he provision of such an authentication method in w hich 
data representing the content of the w ho le or a poB Son 
^f the image is^ encryp ted a t the time the una^ e is 
p?oJuccd with this encrpted portion of the image 
being mainUi aed with ttie eniire ima^e tor s u bseque nt 
airinenacation ot thej ma^e; 
the provision of such a method in which the encrvption_p f 
the portion of the image is accomplished usin g an 
algorithm that_ has as a_f actor elements of the time at 
whif ^h the ifnage is produced, th es e elements i nc lil3mg 
the month^ day, h our, and minute at which t he imag e is 
produced; , 

the pi^ g yjsion of such a method in which the image conte nt 
encryption code changes minute by minute, so 15 ^ 
results from the encryption of an image at one minu te 
produces-aiLauthentication code which is different fro m 
t he authentication code which would result if_ the 
encryption were made a minute eariier or a mmu te 
^ Ijten 

the provision of such a method by which, once the image 
is authenticated, if the image subsequently tampered 
with, or otherwise altered, such tampering or alteration 
is not only immediately discernible, but the portion of 
the image which has been tampered with or altered can 
be readily identified; 

the provision of such a me,thod by which the visual image 
is converted to a data format arranged in a first array 
and subsequently processed through successive arrays 
or linear vectors as part of the encryption process; 

the provision of such a method in which a checksum value 
is ultimately derived for the processed image, the 
checksum value then being placed in a header attached 
to the original image, the image and header then being 
stored or transmitted together so the checksum infor- 
mation can be used to provide image authentication; 

the provision of such a method to further include in the 
header information as to where the image was taken 
and the time at which the image was formed; 

the provision of such a method in which encryption codes 
used in the algorithm used can be varied from one 
location to another, and in which the codes are peri- 
odically changed; 

the provision of such a method which is useful, for 
example, in transmitting pictorial medical infomiation 
from one location to another to verify that an image 
which is received corresponds with that transmitted, or 
in a security system for monitoring a facility and 
detecting a breach in security at the facihty, especially 
where evidence of the breach is captured by a camera 
and it is important to subsequently authenticate the 
image produced for use by law enforcement officials, or 
in court; and, 

the provision of such a method in which the algorithm 
used for producing the authentication is readily incor- 
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porated in image processing eqmpment located at the facility through a door D or window W. The security system 

site where images are produced so authentication for employs an imaging means which is represented in FIG. 1 

the image can be created when the image is produced. by video cameras V1-V3. The cameras arc strategically 

In accordance with the invention, generally stated, a located throughout the facility to capture an image of an 

method is Uught for authenticating a video image created by 5 intnxder when faciUty security is breached. In FIG. 2, 

a camera or other video device. The visual image is trans- security system 10 is shown to include a processing means 

fonned into a data format with a 2Kiimensional array being ^ for processmg any image captured by a camera V If it is 

created in which each pixel forming the image is represented determmcd an miagc from a camera inc udes that of an 

L J* -jf J* -ji^u ttT', mtruder, it becomes important to process the image so the 

by a data word of predetcnnmed length. Hiis array may be . determined. It is also ^portant 

converted mto a second 2Klimensional array of a size lo that the image be authenticated so if it is stored for later use, 

different than that of the first array to reduce the required transmitted to the authorities, it can be immediately 

data transmission rate. This is not an essential part of the determined that the image is authentic, or if not, where an 

algorithm but may simply be a practical necessity. It will be alteration to the image has occurred This is important for 

understood that the algorithm works for all pixel formats evidentiary purposes. Those skiUed in the art wiU recognize 

(512x480, 384x288, etc.). This conversion is performed 15 other situations in which image authentication is useful. For 

using a set of mlcs by which certain rows and columns m the example, as previously mentioned, it is now common to 

formatted array are eliminated. A first Imcar vector is now transmit visual images of a patient from one place to another 

formed and includes the data words transferred from the first diagnostic purposes, for example. Using the method of 

to the second 2-dimcnsional array. Asccond linear vector is ^^^^^^^ invention, any transmission errors caused for 

formed by rearranging the data words m the first linear 20 ^^hatever reason, can be immediately ascertained. Tliis pre- 

vector, the new locations of the data words m the second ^^^^ -^^^^^^^^ ^ transmitted image from being com- 

hnear vector bcmg randomly selected. Achecksum IS deter- ^^^^ method of the present invention provides a 

mined using the data words as ananged m the second linear ^^^^ p^^^^^^ ^^y which image authentication is achieved, 

vector. A header is created usmg the resulting checksum, ^ur^hcT, the encryption tediniques employed in carrying out 

information identifymg the device used to create the visual 25 process result in the authentication of an image which 

image, and the time the visual image is produced. This different at one time from another, 

header is attached to the formatted array. Other objects and Referring to FIG. 3, the original image captured by a 

features wiU be m part apparent and in part pomted out ^^^^^^ ^ Comprises a plurality of individual pixels. Each 

hereinafter. p^^j converted into a data word, for example, a 6-bit 

BRIEF DESCRIiniON OF THE SEVERAL ^^^^ word. The data words can then arranged into a 

VIEWS OF THE DRAWINGS 2-dimensional formatted array having m rows r and n 

columns c. A 2-dimcnsiDnal array of 480 rows and 512 

In the drawings, FIG. 1 represente a facility where a columns is designated Al in FIG. 3. Designations for the 

security system utihzing the image encoding and authenti- pjxel locations start at the upper left comer of the array, and 

cation method of the present invention is installed as an proceed across and down the array to the lower right. The 

example of the usefulness of the method; value of a pixel in the array at a position m,n is given by p„^ 

FIG. 2 is a simplified block diagram of an image pro- with the upper left pixel in the array being designated po q, 

cessing system in which the authentication process is and the pixel in the lower right p479^ii. 

employed; ^ In accordance with the invention, anay Al representing 

FIG. 3 is a representation of the steps performed in the original image is first converted into a second and, if 

accordance with the method to produce an image authenti- necessary for data reduction, smaller array A2. In FIG. 4, 

cation* ^^^y ^ ^ shown to include a plurahty of rows r^, r^, . . . 

FIG. 4 illustrates a 2-dimeDsional arrangement of data ^^-i^ and a plurality of columns C. c^, . . . c^„ C . In 

words representing pixels forming the visual image; 45 inverting from array Al to array A2, the process involved 

™^ / . r J t- may require the elimination of rows and columns from array 

FIG, 5 Illustrates a hnear vector fomied by convertmg a accordance with a set of rules. One such set of rules 
2-dimensional array; 

HG. 6 illustrates a portion of the process by which a eliminate the even numbered rows if the hour at which 

checksum is produced for image authentication; ^^^^ ^ ^^^^^^ ^ ^ ^^^^ numbered hour; 

FIG. 7 is a simplified representation of a header which is eliminate the odd numbered rows if the hour at which 

created using the checksum and infonnation relating to the the image is formed is an odd numbered hour; 

time and place the image was produced; eliminate the even numbered columns if the day of the 

FIG. 8 is a simphfied representation of the resulting month at which the image is formed is an even num- 

authenticated image; and, bered day; and, 

FIG. 9 illustrates the steps performed in carrying out a b) eliminate the odd numbered columns if the day of the 

second form of the method of the invention. month at which the image is formed is an odd num- 

Corresponding reference characters indicate correspond- bered day. 

ing parts throughout the drawings. In accordance with these mles, the resulting array A2 will 

60 be a 240x256 2-dimensional array in which the constituent 

DETAILED DESCRIPTION OF THE ^^^^ words included in the array will change from one hour 

INVENTION to the next. Further, it will be appreciated that the rules can 

Referring to the drawings, the method of the present use other elements for the measure of time (hours and 

invention is used to authenticate a visual image which may minutes), and also that the rules can require other manipu- 

be produced in any of a number of different circumstances. 65 lations beside the elimmation of every other row or column. 

For example, a facility F employs a security system 10 to This means that array A2 could be a larger or smaller array 

detect the presence of an intmder I who may enter the than the 240x256 anay shown in FIG. 3. 
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Once array Al is converted into array A2, the next step is 
to convert array A2 into a linear vector A3. This is done by 
concatenating the data words in the array so they are now 
arranged linearly as shown in FIG. 5. The first element in 
Unear vector A3 comprises the 6-bit data word for the first 
pixel po^o array A2. The next pixel is p^ then p^ 2> ^uid 
so forth'through to pixel P239255. The resulting vector has 
a vector length of 61,440 data words (240*256). 

Linear vector A3 is next transformed into a second linear 
vector A4. As indicated by the arrows in FIG, 3, the locations 
of the data words are shuffled so the locations they occupy 
in array A4 is unique and is determined in accordance with 
a look-up code provided to processing means 12. According 
to the code, vector locations in vector A3 are randomly 
redistributed in vector A4. The position shuffling code is 
changed on a periodic basis which can be monthly, daily, 
hourly, or by the minute. As a result, the location of the same 
words transferred from vector A3 into vector A4 will be 
different from one time to another. 

After forming vector A4, the method next includes the 
calculation or determination of a checksum for the data 
words as they are now arranged in this vector. In performing 
the checksum, a location on the linear vector is selected as 
a starting location. The location selection is done using a 
formula which incorporates elements of the time at which 
the image is formed. Again, these can include the month, 
day, hour, and minute at which the image is produced, or a 
combination of the elements. Each of these four time ele- 
ments may, for example, have a value ascribed to it. The 
elements are then combined in a predetermined maimer. 
That is, one element may be added to, subtracted from, 
multipUed with, or divided by another element. Constants 
can also be used with the elements. Those skilled in the art 
will appreciate that a wide range of combinations are 
possible without departing from the scope of the invention. 
If minutes, for example, are used in the formula, then a 
starting location determined in accordance with the formula 
will change minute by minute. Accordingly, the starting 
location selected in array A4 at one minute will be different 
from that which is selected the next minute. 

Referring to FIG. 3, the location in array A4 where a 
checksum determination starts is indicated. As indicated by 
the Fig., a predetermined block Bl of words, 256 for 
example, is selected and their corresponding bit values 
sequentially sunmied. After the first summation is complete, 
a second predetermined block B2 is taken and the process 45 
repeated. As shown in FIG, 6, the checksum determination 
includes taking 256 consecutive data words DW1-DW256 
from array A4. The most significant bits of each data word 
are summed together to produce a value 2msb. Hie process 
is repeated for each colimin of bits until the sum of the least 
significant bits 21sb is calculated. Each summation is used to 
form 6 new data bytes for the respective summation values. 
Because anay A4 includes 240 blocks B1-B240 each having 
256 data words, at the end of the checksum process, a 
sequence of 1,440 bytes (240*6) will have been produced. 
These bytes now represent an encrypted value of the con- 
tents of the original image. 

A second checksum is derived by taking the first value 
previously chosen and adding the bits from the next 256 
entries further along (i.e., the first entry in the next block in 
array A4) and continuing the summation for all 240 blocks 
of data words. Then starting at the next entry of the original 
btock, another diecksum is found. This process is continued 
until aU entries in the block are exhausted, and will result in 
an additional 256x6 checksum. 

Next, a header H is formed using the checksum values and 
information relating to the camera which produced the 
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image and the time (month, day, hour, and minute) at which 
the image was formed. As shown in FIG. 7, header H has 
two parts. The first part HPl includes the camera and time 
reference information. The second part HP2 includes the 
1440 checksum bytes. It will be understood that the infor- 
mation relating to the camera identification and time refer- 
ence wiU comprise a plurality of bytes and the location of 
these bytes may be scrambled within header part HPl. It will 
further be understood that the values for the respective time 
elements may again be mathematically combined so a month 
value, for example, may be added, subtracted, multiplied, or 
divided by a constant value. After the header is formed, it is 
attached to the initial image array to form a completed 
authenticated image AI (see FIG. 8). As shown in FIG. 2, 
this authenticated image is what is supplied by processing 
means 12 to transmission or storage means 14. 

Since header H includes time information about when the 
image was produced, this information, together with the 
checksum value, can be used to authenticate the image at a 
later time or different place. If the authentication reveals that 
the image content is not that of the original image, the 
location where a change has occurred is determined from by 
reference to the checksum. Since the formatted image array 
is a 2-dimensional array, any change in the content will 
effect values for both the row and column where the change 
occurs. The checksum value is derived from the information 
content in the original array, and so incorporates both row 
and column values. Reference to the checksum will there- 
fore locate where within the array a content value has 
changed. It will be appreciated that because of all the 
possible authentication combinations which can result from 
use of the process, that it is virtually impossible for someone 
to be able to intentionally change the content value of the 
image in a way that will not be detected. 

Referring to FIG. 9, a second manner for canying out the 
method of the invention includes converting the original 
image array Al to a second array A2, as before, with the 
rows and columns which are eliminated being determined in 
accordance with an estabhshed set of rules. Now, instead of 
converting 2-dimensionaI array A2 into a linear vector, a 
third 2-dimensional array AS is created in which the rows 
and columns are shuffled in a random sequence. The code by 
which this shuflQing occurs is again periodically changed so 
that the repositioning which results at one time differs from 
that which occurs at another. Thus, in array A5, the first pixel 
no longer is the pixel po q, but rather a pixel p^^„^; and the 
last pixel no longer pixel p239;25s? ^ pixel p„„^. A 
checksum is again created, this time by calculating check- 
stmis for the rearranged rows and columns in array A5. The 
location within the array where the checksum determination 
starts is again based upon a formula which include values 
representing elements of the time the image is produced. The 
result is that the location in the array where the checksum 
starts will be different for one time at which an image 
formed to another. Once the checksum has been completed, 
a header H sunilar to that shown in FIG. 7 is formed. The 
first portion HPl of the header again includes location and 
time information about the image and the second portion 
HP2 the checksum vector. The header is attached to the 
original image array Al to produce the authenticated image 
AI. 

This second way of carrying out the method of the 
invention also has the advantage of authenticating the image 
at a later time and also of albwing immediate determination 
of whether and where a change in content of the original 
image has occurred. Further, this approach has the advantage 
of requiring only 496 words (240+256) to be processed 
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rather thaa the 61,440 words required in executing the 
method as previously described. 

What has beca described is a method of authenticating 
v isual ima pj cs to verify that the content of an image viewe d 
a t a later time is the same as that when the image was 
produced. Or. if the image content has changed, this "is 
readily detected as well as the location within the miage 
where a change has occurred. The image is encrypted at^ its 
'source and the authenticatio n rem ains the image 
re^dlcss of its^supse que nt use^or^this purpose, the 
algorithm u sed to produce the authepticated image is inco r- 
iroratea in miage processing eq uipment located at the"si t6 
where the imaue b> i^i'OdUCfedADd authentication occurs at th e 
time the image is produced. Authentication is accomplished 
by an algorithm which may include as one factor elements 
of the time at which the image is formed. These elements 
includes the month, day, hour, and minute at which the 
unage is created. Because encryption can change on a basis 
of time, an authentication code for an image at one time will 
be different from an authentication code for the same image 
made at a different time. Also, because of the range of 
combinations which can possibly be used to authenticate an 
image it is virtually impossible for a change in image content 
to go undetected. The method is useful in a wide range of 
applications where it is image content be must be verified at 
a different time or place from those where the image is 
created. 

In view of the foregoing, it will be seen that the several 
objects of the invention are achieved and other advantageous 
results are obtained. 

As various changes could be made in the above construc- 
tions without departing from the scope of the invention, it is 
intended that aU matter contained in the above description or 
shown in the accompanying drawings shall be interpreted as 
illustrative and not in a limiting sense. 

Having thus described the invention, what is claimed and 
desired to be secured by Letters Patent is: 

1. A method of authenticating a video image by forming 
the image into a data format, encrypting a portion of the 
formatted image, and attaching the encrypted portion to the 
original image so the content of the original image can 
thereafter be authenticated by reference to the encrypted 
portion thereof, said formatted image comprising a 
2-dimensional array of pixels each of which is represented 
by a data word of a defined length and the method includes 
converting the formatted image from said 2-dimensional 
array into a second 2-dimensional array, 

2. The method of claim 1 further including detecting any 
modification to the content of the original image and deter- 
mining where in the image the modification occured. 

3. The method of claim 1 further including fomiing a 
header for the formatted image using the encrypted portion 
thereof, attaching the header to the formatted image, and 
storing or transmitting the header with the formatted image 
for authenticating the image. 

4. The method of claim 1 wherein forming the second 
2-dimensional array includes manipulating the rows and 
columns of the formatted array by a set of rules which 
incorporate the time at which the original image is formed. 

5. The method of claim 4 further including converting the 
second 2-dimcnsional array into a hnear vector by concat- 
enating the data words contained in the second array. 

6. The method of claim 5 further including converting the 
aforesaid hnear vector into a second linear vector in which 
the position of the data words in the first Hnear vector are 
located at different positions in the second Hnear vector, the 
positioning of the data words in the second linear array being 
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determined in accordance with a predetermined code by 
which the data words are randomly positioned in the second 
Hnear vector. 

7. The method of claim 6 further including determining a 
5 checksum using the data words as arranged in the second 

Hnear vector, the chedcsum determination beginning at a 
location in the second hnear vector which is established by 
a formula in which values representing elements of the time 
at which the image is formed are included. 

8. The method of claim 7 wherein determining the check- 
sum includes successively summing the values of each of 
the bits comprising a predetermined number of data words, 
the summation beginning with the most significant bit in 
each data word and proceeding through to the summation of 
the least significant bit thereof. 

1^ 9. The method of claim 8 wherein determining the check- 
sum further includes computing a checksum for blocks of 
data words each of which comprises the predetermined 
number of data words until a checksum is produced which 
includes all the data words in the second Hnear vector 

20 10. The method of claim 8 further including forming a 
header which is attached to the formatted array, one portion 
of the header including data words representing the check- 
sum value for the data words contained in the second Hnear 
vector, the checksum value contained in the header being 

25 used to authenticate the contents of the formatted image. 
11. The method of claim 10 wherein another portbn of the 
header is formed by combining information relating to an 
identity and location of a device used to form the image, and 
the time at which the image is formed. 

30 12. The method of claim 3 wherein the operations per- 
formed in producing the authentication are incorporated in 
an algorithm, portions of the algorithm including values 
representing elements of the time at which the image is 
formed, the values of the time elements periodicaUy chang- 

35 ing whereby an authentication for a formatted image pro- 
duced at one time would be different from the authentication 
for the same formatted image if produced at a different time. 

13. The method of claim 4 further including repositioning 
the rows and columns in the second anay, the repositioning 

40 being determined in accordance with a predetermined code 
by which the rows and columns are randomly repositioned 
into a third 2-dimensional array. 

14. The method of claim 13 fiirthcr including determining 
a checksima for the third array by successively summing the 

45 values of the bits forming the data words for each row and 
column of the third array, the summation beginning by 
summing all of the most significant bits in the data words 
and proceeding through to the least significant bits thereof, 
the checksum determination beginning at a location in the 

50 third array established by a formula in which values repre- 
senting elements of the time at which the image is formed 
are included. 

15. The method of claim 14 further including forming a 
header which is attached to the formatted anay, one portion 

55 of the header including data words representing the check- 
sum value for the data word values contained in the third 
array, the checksum value contained in the header being 
used to authenticate the contents of the formatted image. 

16. The method of claim 15 wherein another portion of the 
50 header is formed by combining information relating to an 

identity and location of a device used to form the image, and 
the time at which the image is formed. 

17. A method of authenticating a video image comprising: 
creating a video image using a video device; 

65 formatting the image created by the device into a first 
2-dimcnsional pixel array in which each pixel is rep- 
resented by a data word of a predetermined length; 
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converting the first 2-dimensional array into a second 

2-dimensional array by manipulating the rows and 

columns in the first array; 
forming a linear vector using the data words in the second 

array with the location of data words being randomly 5 

selected; 

determining a checksum from the data words in the linear 
vector; 

foraiing a header using the checksum, information iden- 
tifying the device used to create the image, and the time 10 
at which the image is formed; and, 

attaching the header to the foraaatted array representing 
the original contents of the image for the header to be 
stored or transmitted with the formatted array with the 
information contained in the header used to authenti- 
cate the image. 

18. The method of claim 17 wherein the second array is 
smaller in size than the first array and is formed by elhni- 
nating selected rows and columns in the first array, the rows 
and columns which are eliminated being determined in 
accordance with a set of rules incorporating elements of the 
time at which the image is formed. 

19. The method of claim 18 further including converting 
the second anay into a first linear vector by concatenating 
the data words in the second array. 

20. The method of claim 19 further including converting ^ 
the first linear vector into a second linear vector in which the 
position of the data words in the first linear vector are 
located at different positions in the second linear vector, the 
positioning of the data words in the second linear array being 
determined in accordance with a predetermined code by 
which the data words are randomly positioned in the second 
linear vector. 

21. The method of claim 20 wherein determining the 
checksum includes: 

selecting a predetermined number of consecutive data "^^ 

words in the second linear vector; 
summing the contents of the data words beginning by 

summing all of the most significant bits in the data 

words and proceeding through to the least significant ^ 

bits; and, 

computing a checksum for blocks of data words each of 
which comprises the predetermined number of data 
words until a checksum is produced which includes all 
the data words in the second Linear vector, the location 
in the second linear vector where the checksum deter- 
mination begins being established by a formula in 
which values representing elements of the time at 
which the image is formed are included. 

22. The method of claim 21 wherein the location in the 
second linear vector where the checksum determination 
begins is a function of the month, day, hour, and minute at 
which the image is formed. 

23. The method of claim 21 wherein forming the header 
includes: 

forming a first portion of the header by combining 
together information relating to an identity and location 
of a device used to form the image, and the time at 
which the image is formed; and, 

forming a second portion of the header including the 50 
checksum value for all the data words in the second 
linear vector. 

24. A method of authenticating a video image comprising: 
creating a video image using a video device; 
formatting the video image into a 2-dimcnsional pixel 65 

array in which each pixel is represented by a data word 
of a predetermined length; 
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converting the formatted array into a second 
2-dimensional array by manipulating the rows and 
columns forming the formatted array; 

detennining a checksum from the data words forming the 
second array; 

forming a header using the checksum, information iden- 
tifying the device used to create the image, and the time 
at which the image is formed; and, 

attaching the header to the formatted array and storing or 
transmitting the header with the formatted array to 
authenticate the content of the original image as stored 
in the formatted array. 

25. The method of claim 24 wherein the second array is 
smaller in size than the formatted array and is formed by 
eliminating selected rows and columns in the formatted 
array, the rows and columns which are eliminated being 
determined in accordance with a set of rules incorporating 
elements of the time at which the image is formed. 

26. The method of claim 25 further including reposition- 
ing the rows and columns of the second array into a third 
2-dimensional array, the repositioning being determined in 
accordance with a predetermined code by which the rows 
and columns are randomly repositioned into the third array, 

27. The method of claim 26 wherein determining the 
checksum for the third array includes successively summing 
the values of the bits forming the data words for each row. 
and column of the third array, the siunmation beginning by 
summing all of the most significant bits in the data words 
and proceeding through to the least significant bits thereof, 
the checksum determination beginning at a location in the 
third array established by a formula in which values repre- 
senting elements of the time at which the image is formed 
are included. 

28. The method of claim 27 wherein forming the header 
includes: 

forming a first portion of the header by combining 
together information relating to an identity and location 
of a device used to form the image, and the time at 
which the image is formed; and, 

forming a second portion of the header including the 
checksum value for all the data words in the third array. 

29. A method of authenticating a video image comprising: 
creating a video image using a video device; 
formatting the image created by the device into a first 

2-dimensional pixel array in which each pixel is rep- 
resented by a data word of a predetermined length; 

converting the first 2-dimensional into a second 
2-dimensional array which is a smaller array than the 
first array, the conversion from the first to the second 
2-dimensional array being performed by eliminating 
rows and columns from the first array in accordance 
with a set of rules incorporating elements of the time at 
which the image is formed; 

converting the second array into a Unear vector by which 
the position of the data words is determined in accor- 
dance with a predetermined code by which the data 
words are randomly positioned in the Unear vector; 

determining the checksum for the image by summing the 
contents of all of the data words in the linear vector 
beginning at a location established by a formula in 
which values representing elements of the time at 
which the image is formed are included; 

forming a header using the resulLmg checksum, informa- 
tion identifying the device used to create the image, and 
the time at which the image is formed, and; 
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attaching the header to the fonnatted array representing 
the original contents of the image for the header to be 
stored or transmitted with the formatted array with the 
information contained in the header used to authenti- 
cate the image. 5 

30. A method of authenticating a video image comprising: 

creating a video image using a video device; 

formatting the video image into a 2-dimensional pixel 
anay in which each pixel is represented by a data word 
of a predetermined length; 

converting the formatted array into a second 
2-dimensionaI array by eliminating selected rows and 
columns in the formatted array, the rows and columns 
which are eliminated being determined in accordance 
with a set of rules incorporating elements of the time at 
which the image is formed; 

repositioning the rows and columns of the second array 
into a third 2-dimensional anay, the repositioning being 
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determined in accordance with a predetermined code 
by which the rows and columns are randomly reposi- 
tioned into the third array; 

determining a checksum for the image by summing the 
contents of all of the data words in the thurd array 
beginning at a location established by a formula in 
which values representing elements of the time at 
which the image is formed are included; 

forming a header using the checksum, information iden- 
tifying the deyice used to create the image, and the time 
at which the image is formed; and, 

attaching the header to the formatted array and storing or 
transmitting the header with the formatted array to 
authenticate the content of the original image as stored 
in the formatted array. 

4 # « DC )tt 
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